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1 FOREWORD 


Quality assurance has been at the core in constructing the Euro- 
pean Higher Education Area since the very beginning of the build- 
ing process. It serves as a tool for trust, enhancing compatibility of 
degrees across Europe, increasing academic mobility and fostering 
a sense of belonging to a community. As a result, the cooperation 
among European nations in the field of quality assurance has in- 
creased in recent years. 

The modernisation agenda of the European Union notes that qual- 
ity assurance is a powerful tool for reaching institutional changes. 
However, there is still work to be done. A significant area in quality 
assurance that still requires further development is the involvement 
of students. This area is often neglected, as students are rarely asked 
about their views on the quality of higher education, especially in 
relation to any reforms in that field. 

The three-year project called Quest for Quality for Students, or 

quest for short, examines these developments from the students’ 
point of view. The quest research project was officially launched in 2010 by the Euro- 
pean Students Union (esu) * 1 with financial support from the European Commission. 
quest aims to identify students’ genuine perception of what quality higher educa- 
tion means from a pan-European perspective with the aim of developing a concept for 
quality that corresponds to the learner-centred high quality model of higher educa- 
tion for students in Europe. The main innovation of the project stems from its scope: 
being a pan-European survey of students’ opinions, the outcomes will hopefully influ- 
ence the perceptions of policy-makers and contribute to the construction of a com- 
mon European Higher Education Area. The three year project will be brought to a 
conclusion in 2013. 

The idea of a student-based quality concept will hopefully bring about change in 
the field of quality assurance in higher education by widening the current discussion 
and developing information provision surrounding quality assurance. In engaging in 
developing this concept, esu aims to promote new knowledge, new modes of infor- 
mation and new tools that enhance student participation and evidence-based policy 
making processes in quality assurance in European higher education. 

1 esu — The European Students' Union — is the umbrella organisation of 47 national unions 
of students from 39 countries, and through these members represents over 11 million students. 
The aim of esu is to articulate and promote the educational, social, economic and cultural in- 
terests of students at a European level towards all relevant bodies and in particular the Euro- 
pean Union, Bologna Follow-Up Group, Council of Europe and UNESCO, esu was formerly 
known as esib — The National Unions of Students in Europe, http://www.esu-online.org 
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The European Students’ Union would like to thank the following partners of the 
quest project for their contribution: 


Q The Romanian Agency for Quality Assurance in Higher Education — 
aracis (Romania) is an autonomous, national-level public institution, 
whose main mission is the external evaluation of quality in Romanian 
W higher education at the institutional and study programme levels, ara- 
cis is a full member of the European Association for Quality Assurance in Higher 
Education (enqa) and is registered in the European Quality Assurance Register for 
Higher Education (eqar). 

Student participation in quality Scotland — sparqs (uk) was 
sparqs created to support the greater engagement of students in the manage- 
ment of quality assurance and enhancement in Scotland’s colleges and universities, 
sparqs supports effective student representation. It does this by providing appropri- 
ate training and support materials to the full range of student representatives within 
higher education institutions and colleges and assist institutions and their students’ 
associations to make their systems more effective. 

I ■■ The free association of local student union bodies — fzs 

I (Germany) is the umbrella organisation of student associa- 

tions in Germany and a full member union of esu. With approximately ninety mem- 
ber universities, fzs represents over a million students in the Federal Republic. 


esu also owes a big debt of gratitude to its member unions syl and samoic (Finland), 
creup (Spain), anosr (Romania), srvs (Slovakia) and lsa (Latvia), and their re- 
spective local student unions, which kindly helped us in facilitating the organisation 
of the institutional site visits. We would also like to thank the higher education institu- 
tions that welcomed us to conduct the focus groups and all the individuals with whom 
we met during the site visits. 

All this work would not have been possible without the commitment of our Re- 
search Team and the members of the Students Experts Pool on Quality Assurance 
of esu. The quality assurance pool members were trained during the quest project 
and conducted the institutional site visits, gathering the material used in the report. 
Special thanks should be paid to Henni Saarela (MEd) for her valuable contribution 
to this publication, for conducting the analysis of the institutional site visit materials 
and writing the report. 
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2 INTRODUCTION 


This publication is the second part of Volume II of the project called quest for Qual- 
ity for Students, or quest for short, run by the European Students' Union. It follows- 
up on the research work that has been completed in the last three years, the results of 
which are presented in Volume I and the first part of Volume II. 

Volume I, Quest for Quality for Students: Going Back to Basics, contains the out- 
comes of a desk research that examined existing trends in student engagement in qual- 
ity assurance. It portrays how student participation in quality assurance has increased 
since the beginning of the Bologna process, especially since the European Standards 
and Guidelines for Quality Assurance in Higher Education were adopted in 2005. 
However, it also identifies various obstacles that students face in relation to their in- 
volvement in quality assurance, including the general challenge of empowering qual- 
ity assurance that leads to a real change. 

The second publication, Quest for Quality for Students: Survey on Students' Per- 
spectives, consists of the analysis and findings of an electronically distributed survey, 
which was answered by eight thousand participants in several European countries. 
By analysing the responses based on pre-determined, theory-based classifications of 
quality, the research investigates students’ perceptions of quality, how participation in 
quality assurance enhances quality in students’ eyes and students’ need for informa- 
tion in relation to what they perceive as being quality education and how this all fits 
into current discussion. The results provide several points of departure for further re- 
search and indicate that the comparative approach is a road worth taking in studying 
quality related issues in European higher education. 

This second part of Volume II outlines the main conceptual and political develop- 
ments from key institutional viewpoints to broader stakeholder perspectives on qual- 
ity assurance. It looks more closely at how students form and conceptualise quality 
and student participation and how these perceptions affect the overall discussion on 
quality assurance in higher education in Europe. The premise is that results can be 
used to develop and enhance the involvement of students in quality assurance proc- 
esses at institutional, national and European levels. 

This publication presents a bulk of the in-depth qualitative research conducted 
during the quest project. Approximately fifteen institutional site visits and around 
fifty interview sessions with student focus groups, student representatives and uni- 
versity staff and management, were conducted in five different European countries. 
The main topics of discussion were perceptions on quality, quality assurance in higher 
education and student participation. The site visits were conducted in collaboration 
with local student communities with a representative from the quest project helping 
to coordinate the interview processes. In addition, broader stakeholder perceptions 
on ongoing developments in quality and quality assurance in higher education were 
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collected at a stakeholder conference held in Malta in 2012. Key stakeholders of repre- 
sentative bodies in higher education in Europe were present at the conference. 

In the publication, the results of the stakeholder conference are presented in the 
form of a report called Where are we now and where are we heading? General report on 
a stakeholders' consultation conference in Malta 30 Nov-i Dec 2012. The following chap- 
ter, named Pan-European case study: Conceptualising student perspectives on quality and 
quality assurance in higher education in Europe , presents the findings of the institutional 
site visits. The data collected during the institutional site visits was analysed using 
the grounded theory approach, which investigates meanings and concepts as used by 
social actors in their real settings. Through this method, it was possible to identify the 
common threads and visible frameworks from the inductive analysis. 

A model for pursuing quality emerges from the institutional site-visit data, which 
transcends simply by listing attributes of quality in higher education as they are per- 
ceived by students. Focusing on the wider student-based perspective, this model 
views quality as a process centred on students’ expectations and how they are met. 
This process, or set of processes, incorporates not only the attributes associated with 
quality, but also the basic elements of quality. These elements, or principles and values 
necessary in building quality in higher education, are trust, participation and owner- 
ship. It was found that these elements are interlinked, forming a progressive process 
from trust to partnership all the way to ownership, which is integral to the successful 
implementation of quality assurance activities and quality culture. The findings of this 
study give a new insight into students’ perceptions on quality and patterns relating to 
student participation in quality assurance in a pan-European context. 

The main findings of this publication have been compiled at the end in order to 
enhance its usability for readers, identifying key development areas for enhancing stu- 
dent participation and quality assurance in higher education in Europe in general. 
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3 WHERE ARE WE NOW AND WHERE 
ARE WE HEADING? 

General report on a stakeholders' consultation conference in Valletta, Malta, 
30 Nov-i Dec 2012 


Student participation in quality assurance (qa) has been one of the key issues in the 
Bologna Process, but also one of the success stories of student participation in general. 
The European Students’ Union (esu) has been actively involved in advocating student 
participation in quality assurance processes, esu has, among other things, shared and 
provided its expertise in internal, and external quality assurance processes, in accredi- 
tation or evaluation bodies, and in the work of national and international quality as- 
surance agencies. 

Quality assurance in the European context has developed significantly in the 
past decade or so. In 2000, the European Network for Quality Assurance in Higher 
Education (enqa, now the European Association for Quality Assurance in Higher 
Education) was established. A year later, the Prague Communique of the European 
education ministers acknowledges quality as a major factor in determining the com- 
petitiveness and attractiveness of higher education in Europe. 

Only a few years later, formal quality assurance processes are set out as an action 
line of the Bologna process 1 in the Bologna treaty with the Berlin Communique of 
2003. The main stakeholder groups at the European level, the so-called “E4” (enqa, 
esu, the European University Association (eua) and the European Association of 
Higher Education Institutes (eurashe) were invited to devise a common framework 
for quality and quality assurance in higher education. The collaboration’s end product 
was the establishment of common standards and procedures for quality assurance. 

With the Bergen Ministerial Conference in 2005, the Standards and Guidelines for 
Quality Assurance in the European Higher Education Area (esg) were adopted. The 
ownership of the ESG was not only shared by the founding bodies of the ESG, but also 
by the European states that were committed to the Bologna Process. The ESG applied 
to internal quality assurance systems for higher education institutions as well as exter- 
nal quality assurance procedures and systems. 

Two years later, the European Quality Assurance Register for higher education 
(eqar) was established in order to increase transparency in quality assurance in Eu- 


1 There were other notable initiatives before the Bologna Process (1999), notably Institution- 
al Evaluation Programme (IEP, 1993) that was launched by the Association of European Univer- 
sities (CRE), nowadays European University Association (EUA) and European Pilot Project for 
Evaluating Quality in Higher Education (1994) 
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rope, eqar’s main tasks included publishing and managing a list of quality assurance 
agencies (qaAs), which are seen to substantially comply with the esg’s. 

Today, seven years after the onset of the ESG, the ESG are undergoing revision. After 
a report was put together by the E4, the representatives of the signatory countries of 
the Bologna process decided to update the ESG. The aim of that revision is to improve 
their clarity, applicability and usefulness, and scope. The revision will be based on 
an initial proposal prepared by the E4 in cooperation with Education International, 
BusinessEurope and eqar. The proposal will be submitted to the Bologna Follow-Up 
Group 2 . 

A consultation conference organised with stakeholders in Malta from 30 Novem- 
ber to 1 December 2012 had its place within these developments. By disseminating the 
outcomes and aims of the project at the conference, the spotlight was directed at core 
issues for students among other stakeholders that were put up for a general discussion. 
These issues included the relationships between quality assurance processes at differ- 
ent levels and in different contexts (internal, institutional, external, external reviews 
of quality assurance agencies), the visibility of the outcomes of quality assurance ac- 
tivities and involvement of stakeholders (with special focus on the role of students). 
The conference also discussed possible scenarios for the future in quality assurance in 
higher education in Europe. 

This chapter covers the general discussion taking place at that conference and 
analyses students’ opinions and participation in quality assurance in relation to stake- 
holders’ views. 


3.1 STAKEHOLDER PARTICIPATION IN QUALITY ASSURANCE 


The topic of stakeholder participation in quality assurance was raised in various ses- 
sions during the conference, focusing on this particular subject. A general conclusion 
of these sessions was that, irrespective of the level reached in quality assurance, all 
stakeholders in European universities (academic and administrative staff, research- 
ers, students) must participate in institutional affairs. The participants agreed that 
students are — or should be — full, or equal, members of the academic community. 
Students should be involved because they have a duty or responsibility to do so, not 
because they are customers of the higher education system. 

The participants had the chance to exchange experiences and good practices of stu- 
dents’ involvement in quality assurance in working group sessions. Overall, it seemed 
that student participation in quality assurance was a success story within the Euro- 
pean Higher Education Area. However, there were still many areas that needed to be 
improved and issues that needed to be addressed in order to ensure an effective and 


2 Bucharest Communique 2012 
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genuine student participation in quality assurance processes. For example, student 
participation in profession-oriented or study-field specific accreditation was consid- 
ered to be very limited in many parts of Europe 

Another important question that was addressed at the conference was how genu- 
ine student participation in quality assurance should be differentiated from formal 
participation. In a number of cases, students are only involved “on paper”, meaning 
that the formal or bureaucratic prerequisites are in place but students are not actively 
engaged in the process, for whatever reason there may be. This kind of a token pres- 
ence is not sufficient to ensure student participation. Other insufficiencies were high- 
lighted at the institutional level (where the core of quality is), such as how quality 
assurance was presented to students and made relevant to them. 

The transparency of quality assurance procedures was a key challenge mentioned 
during the session. This was considered to be an important element because students’ 
motivation for participating in quality assurance and development activities could be 
enhanced only if the activities for quality assurance and procedures would be effective 
and visible. 

Stakeholders at the European level strongly agreed that students’ role as partners 
in quality assurance and in the life of higher educational institutions in general was 
not only beneficial but also necessary. However, a few inherent limitations to student 
participation were identified. One of the main challenges was believed to be the short 
life-cycle or study-cycle of students. An average study period of about three to five 
years was considered to be a time period which would be very difficult for develop- 
ing a genuine knowledge of and a “feel” for a particular university. Changes in higher 
educational institutions, on the other hand, occur very slowly, especially in older and 
larger universities. 

Related to this, the participants mentioned the fact that the results or outcomes of 
quality assurance exercises were usually not visible to students within a short time- 
frame. This was also linked to one of the topics of this conference: the impact of qual- 
ity assurance through visibility. If students provided feedback on a course or the work 
of a teacher (e.g. in a feedback meeting), and the feedback resulted in changes made by 
academic staff, the participating students would need to be made aware of the changes 
they initiated and that their input was valued. 

Despite the challenges, it could be said that much has been achieved over the past 
years in enhancing student participation in quality assurance. Indeed, student par- 
ticipation has to be seen as a continuous process. (Here, it must be remembered that 
the degree of success in achieving student participation varies across the European 
Higher Education Area. Differences stem not only from the development stage of na- 
tional and institutional quality assurance systems but also from historical, political 
and cultural differences.) 

The discussion point of how the outcomes of quality assurance can be made vis- 
ible and accessible to all the direct stakeholders was returned to on several occasions 
during the conference. However, it was stressed that outcomes also need to be made 
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visible to the wider public. The latest development in higher education in Europe and 
quality assurance policies has showed that reports have become increasingly available 
and visible (external review exercises, self-evaluation reports and even internal evalu- 
ations in some cases). More needs to be done in that area in order to make the reports 
and outcomes of quality assurance processes truly accessible to the stakeholders, not 
only the formal provisions. 

The concept of “cognitive accessibility” was mentioned in relation to visibility. 
Cognitive accessibility supports the idea of putting the outcomes of quality assurance 
(reports, for example) in a plain and conceivable form in order to facilitate understand- 
ing in the society at large and among the stakeholders themselves. 

The tricky nature of terminology and jargons also raised discussions on how qual- 
ity assurance can sometimes be detached from daily life at higher educational institu- 
tions. Neither students nor staff may realise that they are in fact actively dealing with 
a process related to quality assurance on a day-to-day basis, for example in the process 
of designing and developing curricula which is a part of the quality assurance. The un- 
derstanding of quality assurance needs very much to be changed, to move away from 
the notion of it being purely a bureaucratic process. 

Last but not least, an important remark was raised during this session about stu- 
dents’ readiness to participate in quality assurance processes and the need for an ap- 
propriate training in issues related to quality assurance. It was considered to be impor- 
tant that students themselves advance the idea of an active student engagement, train 
other students and make quality assurance activities an interesting and an appealing 
part of university life. 


3.2 DIFFERENT VIEWS ON QUALITY IN HIGHER EDUCATION 


Based on the assumption that stakeholders have diverse perceptions and expectations 
towards higher education institutions, they will also hold very different views of what 
quality in education is and how it should be boosted and maintained 3 . 

Stefan Delplace, as General Secretary of eurashe, a representative entity for 
professionally oriented programs, applied and profession-related researches, was of 
the view that it was important for us to ask ourselves what purpose higher education 
serves. Is it for personal development, professional enhancement, discipline-oriented 
teaching, or employability? In effect, a student who graduates from any type of edu- 
cation must be employable, but we must also remember that this concept does not 
mean the same thing as employment. Employment refers to the process when you 
prepare someone for a job. Employability, on the other hand, implies life-long skill- 
sets required for developing a career. He also reminded us that not all changes were for 


3 More on different perspectives on QA in the QUEST research publications 
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the better. We were now undergoing an economic crisis, which affected employment. 
However, this type of a general economic influence over education and employment 
or employability- driven education were not permanent trends per se. 

Achim Hopbach, President of the enqa, believed that things had changed tremen- 
dously in the last years and that it was easy to track those areas where quality assur- 
ance had an impact. However, it was very difficult to measure this aspect and not even 
sure if it should be done. For instance, external quality assurance is one of the major 
new steering mechanisms in higher education and, together with other mechanisms, 
it does clearly have an impact. What kind of an impact is, on the other hand, difficult 
to pinpoint exactly. 

Tia Loukkola, head of Quality Management and Institutional Evaluation Pro- 
gramme unit of the eua, brought the perspective of universities into the discussion, 
arguing that there was a relationship between quality and quality assurance, but it was 
hard to demonstrate. Quality assurance procedures would not assure quality alone, 
but they were able to detect it. Too many regulations on the learning process might 
lead to less innovation, which was too, a part of quality education. Hence, quality 
assurance had the potential of promoting quality, but this would not happen with- 
out changes in attitudes and behaviours at the individual level. When asked if qual- 
ity assurance had become a great bureaucratic burden for the universities, Loukkola 
reminded that bureaucratic tendencies tend to lie at both ends. At eua, they would 
like to see more institutional accreditation rather than more regulatory programme 
accreditation. 

It was mentioned during the session that students had a uniquely intrinsic moti- 
vation for getting involved in quality assurance. The improvement of students’ study 
programmes and universities in general was, as such, also the improvement of their 
own education. For the students, it was considered to be especially important to focus 
on the quality of teaching outcomes and on providing a good environment for the 
teaching and learning process. 

Finally, an important point was raised in the discussion about quality culture. We 
will always have quality culture, but it can be good or bad. Fruitful quality culture 
requires engagement, shared responsibility among the actors in the higher education 
community and procedures that facilitate these goals. It is not good to leave or restrict 
work in quality enhancement and quality assurance to a single operational unit. 
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33 QUALITY AT DIFFERENT LEVELS: WHERE DOES THE LOOP CLOSE? 
The link between external and internal quality assurance 


Throughout the conference, reflections and discussions on how external quality as- 
surance could trickle down to the institutional level and advance a quality culture 
where strong and meaningful student participation is present and where learning it- 
self would be more student-centred, were carried out. 

One of the main remarks made by the participants was that external quality assur- 
ance should complement internal quality assurance. The final goal would be to estab- 
lish a working, overarching quality system where everyone would be committed to 
producing and maintaining a quality culture. External quality assurance should only 
be a supporting mechanism and not a strict instrument of control. 

External quality assurance provisions would have to respond if internal (institu- 
tional) processes are lacking, but they should not, and cannot, replace the the internal 
ones. Instead, the external mechanism for quality assurance should foster the idea 
that institutions are responsible for their own quality and that it should guide higher 
educational institutions to ensure the fitness of purpose of the education they provide 
and for them to be(come) fit for their purpose. In some cases even now, agencies did 
not act as the ‘judge and jury’ but as a helping hand, enabling development and en- 
couraging collaboration. This should be a widespread practice. 

The periodicity of the external reviews was another point tackled by the partici- 
pants. Because the majority of national regulations prescribed a five-year cycle, the 
participants believed that there was a time-gap in the system which hindered a con- 
tinuous engagement in quality assurance and enhancement processes. The same thing 
was valid in the cases of reporting. It was common for universities to prepare reports 
exclusively for and before an external review took place. 

The participants also discussed how external and internal processes for quality as- 
surance were linked in the minds of people working within these systems. Sometimes 
those actors would get so caught up in external reviews that they would forget to sit 
down and think about what quality assurance means at the grass-root level, in other 
words, what it means for students, teachers and other stakeholders. 

In conclusion, despite the external review philosophy being based on the continu- 
ity of the quality assurance process, that does not really happen in practise. Many of 
the activities are ongoing but peak around and during reviews. The time in between is 
not as active. Ongoing follow-up and development should, in most instances, be initi- 
ated at the management level of the university and in collaboration with stakeholders. 


10 


QUEST— INSTITUTIONAL ANALYSIS 


WHAT NEXT? ABOUT THE ESG REVISION, RANKINGS AND STUDENTS 
PURSUING QUALITY EDUCATION 


There are at least three crucial points that need to be raised when it comes to the future 
development of quality assurance policies at the European level. 

Firstly, discussions on the practical utility of the ESG were carried out with the Map 
ESG Project 4 5 and the conclusions of the Bucharest Ministerial Conference of the Bolo- 
gna process in 2012. The participants of the quest conference in Malta agreed that the 
ESG define the generic principles in quality assurance but not procedures, as was ex- 
pected originally by some stakeholders. The ESG prescribed what institutions should 
do, but not how. Thus, it relied on the core principles, of: institutional responsibilities 
for quality assurance; the fitness for purpose of external quality assurance (there is 
still a variety of approaches of external quality assurance used at the European level); 
stakeholder participation; and context sensitivity (not a one-size-fits-all approach). 
There are huge differences in national quality assurance systems (from programme 
and institutional evaluations, to accreditations and audits) and also a great autonomy 
in establishing internal systems for quality assurance. 

In terms of transparency in quality assurance, the main issues discussed con- 
cerned who, when and for what purpose the resulting public information was sup- 
posed to serve. Stakeholders’ definitions of quality and transparency varied: different 
stakeholders had different demands. In conclusion, it would not be sufficient to apply 
a single tool for transparency in higher education. 

Currently, there are several different university and higher education rankings tak- 
ing the world by storm. At the Malta conference, the existing rankings were criticised 
for having unspecified target groups and for ignoring the diversity within institutions. 
Also, those rankings work with a narrow range of dimensions, like traditional research 
and reputation, without due consideration towards diversity among institutions. An- 
other highly problematic issue with rankings is the composition of the overall indica- 
tors used. Those indicators make the results understandable but difficult to formu- 
late in a credible manner, if tied to unspecified and potentially volatile methodology. 
Lastly, there was also a question raised about the possible bias within the scientific 
field and by region and language in citation databases. 

The ongoing U-Map s project is a reaction to the more or less mono-dimensional 
global university rankings. This mapping project, supported by the European Com- 
mission, is based on empirical data and informed by multi-stakeholder and multi- 
dimensional perspectives. It is to be user-driven, non-hierarchical, applicable to all 
higher educational institutions in Europe, based on reliable and verifiable data and 
parsimonious regarding collecting extra data. All those details still have to be ad- 

4 See more at: http://mapesg.wordpress.com/ 

5 http://www.u-map.eu/ 
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dressed. The implementation had not yet reached its final stage when the conference 
in Malta was held. 

As mentioned in previous section, it was emphasised at numerous occasions that 
top-down inflicted changes in policies do not necessarily lead to changes of mind- 
set, and hence changes in quality culture in institutions. Thus, it is imperative for all 
stakeholders to actively participate and contribute to developments activities higher 
educational institutions. 

When it comes to students’ involvement and the participation of students in quali- 
ty assurance, it is already defined by the ESG at institutional level, external reviews and 
in quality assurance governance. Still, it must be remembered that there is a marked 
difference between formal and active involvement of students in quality assurance. 
Thus, the recognition of students as full and active stakeholders in quality assurance 
processes will remain to be an issue. 

Students all over Europe should become active and informed and get involved 
in quality assurance. Students should not let their guard down if they are currently 
outside those processes, but instead actively push it onto the agenda. For instance, 
the eua-iep (institutional Evaluation Programme) had a very heated debate at the 
European level about whether to introduce students in review panels or not. Today, 
however, students have been included and there is a general agreement on the fact that 
students have had a positive impact. This is, of course, not the only concrete example 
of success in this area. Indeed, students should use all available (and contextually rel- 
evant) examples when making their case of including students in quality assurance 
activities and bodies at the institutional level. 

Finally, an increasingly important point to make is that students, especially at the 
grass-root level, should not adapt to the consumer model for higher education. It is 
extremely hard for students to engage as equal partners if the students assume or are 
assumed to have a consumer role in education. Students should, instead, continue to 
believe that they have an impact on their study processes. There are, at the moment, 
too few students concerned with quality assurance issues. Students should embrace 
their status as the heart of the process. National unions of students and equivalent 
bodies should engage in discussion about their own aims and tools in quality assur- 
ance and engage in a broader discussion with other stakeholders. 
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OVERVIEW OF THE MAIN CONCLUSIONS OF THIS SECTION: 


O National policies and legislative frameworks are necessary, but not sufficient 
to ensure student participation in quality assurance; 

O External mechanisms for quality assurance should foster the idea that institu- 
tions are responsible for their own quality; 

O More needs to be done in order to make the reports and outcomes of quality 
assurance truly accessible to the stakeholders and the wider public; 

O There is a strong need to move away from the notion that quality assurance is 
purely a bureaucratic process; 

O Despite the external review philosophy being based on the continuity of the 
quality assurance process, this does not really happen in practise; 

O Quality assurance procedures will not assure quality alone, but they are able 
to detect it. Too many regulations on the learning process might result in less 
innovation, which is too, a part of quality education; 

O A single tool for transparency in higher education is not sufficient; 

O It is extremely hard for students to engage as equal partners if students also 
assume/are given a consumer role in education; 

O Students have responsibilities as stakeholders and as partners; 

O Students’ motivation for participating in quality assurance and development 
activities can be enhanced only if the quality assurance activities and proce- 
dures are effective and made visible; 

O If students provide feedback, they need to be made aware of the changes they 
have initiated and that their input was valued; 

O It is important that students advance the idea of an active student engagement, 
train other students and make quality assurance activities an interesting and 
appealing part of university life; 
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O The impact of quality assurance activities often comes with a delay; 

O Rankings can be an instrument for providing transparency but it is very dif- 
ficult to encompass the quality dimension of education. 
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4 PAN-EUROPEAN CASE STUDY 


Conceptualising students' perspectives on quality and quality assurance in 
higher education in Europe. 


When the European Students’ Union launched its project, Quest for Quality for Stu- 
dents (quest), it embarked on an ambitious and important adventure. By mixing 
research, practice and capacity-building activities, quest seeks to identify students’ 
genuine perceptions of what quality higher education means from a pan-European 
perspective. It provides the European Students’ Union with a chance to define a stu- 
dent-based concept of quality in higher education that centres on the learner. This idea 
of developing a student-based concept for quality can potentially bring about changes 
in the field of quality development in European higher education. It can help widen 
the discussion surrounding quality assurance and improve the information provided 
by higher education institutions to better reflect the views of students as the main 
stakeholders in higher education. The main innovation of the project lies in its scope, 
a pan-European survey of students’ opinions. 

Institutional site visits were one of the qualitative elements used in the research 
study. Around fifty interviews and/or focus groups were organised with students, 
student representatives as well as university management and staff in five European 
countries. The purpose of these sessions was to examine the students’ perceptions on 
quality, quality assurance and student participation in these areas more closely. The 
interviews were conducted in teams and in collaboration with local student represent- 
atives from different countries. 

The data that was collected during the institutional site visits, such as field notes 
and reports, was examined by using the grounded theory approach, which looks into 
the interpretative processes taking place by investigating the meanings and concepts 
used by social actors in their real settings. The aim was to find actor-based conceptu- 
alisations of quality, quality assurance and the processes related to them. 

The findings of this study give new insight into students’ perceptions on quality 
and patterns relating to student participation in quality assurance in a pan-European 
context. Despite the multi-cultural interface of this project and the different languages 
used in the collection of the data, it was possible to identify the common threads and 
visible frameworks from the inductive analysis. A model for pursuing quality emerges 
from the institutional site-visit data, which transcends listing attributes of quality in 
higher education as they are perceived by students. Focusing on the wider student- 
based perspective, this model views quality as a process centred on students’ expecta- 
tions and how they are met. This process, or set of processes, incorporates not only 
the attributes associated with quality, but also the basic elements of quality. These ele- 
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ments, or principles and values necessary in building quality in higher education, are 
trust, participation and ownership. 


4.1 METHODS 

RESEARCH STRATEGY 

The study is designed to reflect the main aims of the quest project, which are to: 

O identify students’ genuine perception of what quality higher education means 
from a pan-European perspective; 

O define a concept for quality education that corresponds to the learner-centred 
model for quality higher education for students in Europe; 

O to bring change in the field of quality higher education by transcending the 
discussion surrounding quality assurance and information provisions to 
reflect the views of students as the main benefactors rather than simply as any 
other actors, and; 

O be a pan-European survey of student opinion. 

This study examines students’ participation in quality assurance and enhancement 
mechanisms/systems/frameworks, the information students are provided with when 
applying for studies and how this information relates to what they perceive as being 
“quality education”. 

The interviews took place from 2012 to 2013 in five different countries: Slovakia, 
Germany, Romania, Latvia and Spain. The site visits were organised with the help of 
the local national unions and/or project partners. 

The site visits were conducted by a team consisting of two experts, a representative 
of the European Students’ Union (often from the respective country) and a local rep- 
resentative from either the project partner or a local member union. These site visits 
lasted approximately two to three days and included an interview with a representa- 
tive of the quality assurance unit (or similar) at the higher education institution, an 
interview with the student representative in charge of academic affairs and quality, 
and focus groups of students (Eight to ten people including undergraduates and post- 
graduates). 
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The site visits employed the methods of active and passive observation, interviews 
and student focus group exercises. The interviews centred on four key issues, which 
were identified on the basis of the previous parts conducted in the quest research: 

O motivation; 

O perceptions on quality; 

O awareness of quality assurance mechanisms, and; 

0 information needs. 

The interviews and student focus groups were based on a semi-structured interview 
with open-ended questions. Interviewers and interviewees were encouraged to elabo- 
rate and refine their answers if possible. Some interviews were held in local languages. 
Local representatives could act as translators when necessary and also clarified na- 
tional contexts when necessary. 

The challenges involved in doing this kind of a multicultural and student-led re- 
search are considerable. The questions had to be interviewee-friendly in terms of lan- 
guage used but sufficiently open to invite further discussion from among the partici- 
pants. At the same time, a certain structure was necessary in order to get comparable 
data. Keeping in mind language and culture barriers, not to mention the scale of the 
study and the fact that it was carried out in part by students themselves, it can be said 
that the data collection was a relative success, and also, to a certain extent, ground- 
breaking. 

A report was produced by the site visit coordinator following each visit in coopera- 
tion with the other member of the review team. These reports were based on the basis 
of the input received during the interviews and the focus groups. The basic template 
was the following: 

1 Motivation 

2 Perceptions on quality 

3 Awareness of quality assurance mechanisms and quality culture 

4 Information needs 

5 Academic freedom 

For more detailed information on site visit, focus group samples and the interview 
guidelines, please see the Annex of this report. 
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ANALYSIS— GROUNDED THEORY 


Due to the innovative nature of the study and the call from the QUEST-project Re- 
search Advisory Board for something new to add to the discussion on quality, con- 
siderable thought was put into finding a suitable method for analysing the data. The 
inductive approach of Grounded Theory (gt) was found to provide a good tool for 
analysis, the approach potentially providing useful findings in line with this particu- 
lar QUEST-study. The methodology also seemed suitable in approach considering the 
nature of the available data and its inherent weaknesses without compromising poten- 
tially significant findings. 

Grounded theory and its analytical procedure were originally developed by Glaser 
and Strauss (1967). Grounded theory is a general methodology of analysis linked with 
data collection that uses a systematically applied set of methods to generate an induc- 
tive theory about a substantive area (Glaser, 1992, p. 16). In other words, it is a research 
method that focuses on the interpretive process by analysing “the actual production 
of meanings and concepts used by social actors in real settings” (Gephart in Suddeby 
2006, p. 633). The method is used widely by researchers in various fields such as the 
social sciences, business and education. (Glaser, Suddeby 2006, Isabella 1990). 

Grounded theory (gt) does not impose grand theories on data nor does it use hy- 
pothesis-testing or falsification as a basis for its study. Instead, it is an organic process 
whereby theory emerges from the data, based on how well data fits conceptual catego- 
ries identified by an observer (the researcher), how well categories explain ongoing in- 
terpretations and by how relevant the categories are to the core issues being observed. 
Basically, it offers “a compromise between extreme empiricism and complete relativ- 
ism by articulating a middleground in which systematic data collection can be used 
to develop theories that address the interpretive realities of actors in social settings” 
(Suddeby 2006, p. 633-634). 

The findings of grounded theory should fit contextually into wider discussion and 
theoretical frameworks. As such, grounded theory is perhaps more appropriate for 
some questions than others. It is, however, highly suitable to efforts to understand 
processes, such as in this study, by which actors construct the meaning of an intersub - 
jective experience. (Suddeby, 2006, p. 633-634). 

In practice, grounded theory consists of six main phases: open or substantive cod- 
ing, identification of core categories, selective coding, emergence of theory, testing fit 
of theory, and discussion (Glaser 1978). The practice of memoing (taking notes in an 
orderly fashion) takes place throughout the study. 

All data provided in this study was initially coded open by adding a second col- 
umn next to the data text for the purposes of making notes and identifying codes at 
higher levels of abstraction. Coding is essentially digesting and labelling the data for 
what it appears to represent. Any initial ideas on emerging core categories, properties, 
dimensions of properties and how they are all interlinked were jotted down in sepa- 
rate memos on both computer and by hand. The work requires constant comparison 
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of data against any emerging theory. The coding can also generate in vivo codes, i.e. 
words, usually verbatim quotes, from participants that are themselves used as a code 
for the data. 

The initial analysis, referring to the initial coding and memos, were then reviewed, 
and the initial codes refined, and ideas regarding relationships and processes exam- 
ined. This led to the identification of core categories or core issues and core relation- 
ships and processes. In the selective coding process, the data was looked at more selec- 
tively and analytically at higher levels of abstraction, identifying any new and refining 
old codes along the way. This act requires the researcher to interact and engage with 
the data at an in-depth level. Both open and selective coding took place until satu- 
ration occurred. Categories are “saturated” when the analysis of new data generates 
codes that only fit in existing categories, which are adequately explained in terms of 
their properties and dimensions. 

The emergence of the theory required a separate analytical process where the data 
and codes were viewed in higher levels of abstraction and in relation to one another. At 
the end, the fit of the theory was tested against unanalysed existing data. 

“Pure” grounded theory-practitioners may draw attention to the wording and struc- 
ture of the interview guidelines used in this study. To the general audience they may 
seem quite general, but to a GT-enthusiast they may appear too leading, as grounded 
theory generally only uses strictly neutral and general questioning (especially the Gla- 
ser method). This limitation was taken into account at the beginning of the study. It 
is acknowledged that the questions asked will have influenced the direction of the 
discussion to varying extents. However, after weighing in the realities of the data col- 
lection process, the relative strengths and limitations of the data and the strengths 
of using the grounded theory methodology, the pros were thought to outweigh the 
cons. It is also the researchers’ understanding, that the questions were partly built on 
the data received in the desk survey and desk research of the quest project. It could 
therefore be said that the collaborative theory and data collection started emerging al- 
ready during the prior stages of the quest project. Nevertheless, the grounded theory 
mantras, such as “all is data”, “feel the fear and do it anyway” and “just do it”, were also 
found to be encouraging (Glaser, 1998). 

That being said, the study will not result in any conclusive or exhaustive defini- 
tions relating to conceptualisations of quality. However, this analysis will certainly 
bring added value to the quest project’s quest for quality. Bearing in mind that the 
prior desk research and survey were largely based on existing theories (e.g. Harvey & 
Green, Humboldt, consumer-theory), this approach will, in its part, provide a more in- 
ductive analysis and theoretical framework for examining the concept of quality and 
quality assurance practices (esu 2012 , esu 2013 ). 
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COLLECTED DATA 


The data used in the data analysis consisted of interview reports and field notes that 
were provided to the researcher. Unfortunately it was not possible to acquire, tran- 
scribe or translate recordings from each interview session due to technical reasons, 
time restrictions and availability of resources. 

The overall structure, content and language of the reports varied from one country 
to another. The probable causes for this are the collaborative approach used for col- 
lecting data, lack of more specific instructions for producing reports, different levels 
of research skills within the student-led teams, cultural differences, varying language 
abilities as well as the use of different languages during the site visits and for report- 
ing. Most reports were very descriptive, but a few initial attempts at analysis were also 
evident in some of the reports. For the purposes of this study, a few observed attempts 
at abstraction or deeper level of analysis were discarded from the coding process. Re- 
ports included field notes and direct quotations to a varying extent. This was a bonus. 

In many forms of qualitative data analysis, the above-mentioned issues can impose 
serious challenges for a traditional “objective” analysis of the qualitative data (e.g. 
phenomenology). However, there is reason to believe that the intercultural, collabo- 
rative approach and relatively open method of the data collection can also yield sub- 
stantial insight that is able to transcend cultural boundaries. Due to the high level of 
local knowledge present, the site visit teams were, in their reports and field notes, able 
to capture core issues as expressed by students and other stakeholders at grass-root 
levels in different geographical contexts. Because of their trainings and background 
in student participation in quality assurance issues up to the European level, the re- 
searcher feels that the observations that were made by the interviewers during the site 
visits may also lead to more substantial findings — findings that can transcend cultural 
barriers instead of being bound by them. This, of course, is in line with the objectives 
of this study. 

Nevertheless, it is also important that the approach to and methods of data analy- 
sis are chosen and formulated carefully to account for both the limitations and the 
strengths of the data. This is why the grounded theory approach was selected. The 
researcher in charge of analysis must also be able to engage actively and navigate ones 
way effectively through the data, which requires some familiarity with the working 
ground. 

All in all, there is general sense of confidence that the data has been analysed com- 
prehensively and that due cultural sensitivity was taken to ensure that significant dif- 
ferences in meanings related to languages and terminologies were circumvented. Of 
course, the risk is still there though. It would have been useful to have more time to 
conduct an in-depth engagement with the data in order to come up with a more nu- 
anced and detailed analysis. This, however, is perhaps out of the scope and purpose of 
this particular study and the available data. There is a clear need for a follow-up and 
further research on this topic, especially for gathering more in-depth evidence. 
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4.2 CONCEPTUALISING STUDENTS' PERSPECTIVES ON QUALITY AND 
QUALITY ASSURANCE IN HIGHER EDUCATION IN EUROPE 

DISCUSSING QUALITY 
Expectations versus reality 

The student focus groups were asked to identify expectations related to quality issues. 
Hence, the data includes a fair amount of discussion on the attributes associated with 
the quality of higher education. A more technical way to look at them is to view them 
as indicators of quality in higher education. The following list, extricated in the cod- 
ing processes, provides a summarised and categorised list of these associations with 
quality that were made by the interviewees. The list can be broken down to core ex- 
pectations towards the learning process and conditional expectations (that facilitate 
the realisation of core expectations). Core expectations refer to the direct expecta- 
tions that students have about their education, while conditional expectations relate 
to the environment and conditions that are thought to be necessary in realising core 
expectations. 
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Core expectations 


O Teaching content and learning proc- 
ess 

O Teachers have substantial knowl- 
edge and expertise 
O Teachers are committed and have 
pedagogical skills 

O Learning to learn and to structure 
knowledge 

O Learning to respect and work with 
others 

O There is a good balance and mix of 
research and education 
O University studies are different to 
secondary school -» specialisation 
and way of learning 
O Generic competences are gained 
O There is a good balance of theory 
and practice 

O There is a progressive curriculum 
O The curriculum provides students 
with flexibility in their choices 
O The study workload is manageable 
O Internationality 
O There are study exchange oppor- 
tunities 

O Education is recognition abroad 
O There are guest lecturers from 
abroad 

O Employability 

O Learning to apply knowledge 
O Contact-building 
O Learning from practitioners in 
the field 


Conditional expectations 


O Services, facilities and system struc- 
tures related to studying 
O Feedback to students on their work 
and progress 

O Supervision and student guidance 
O Adequate facilities that are fit-for- 
purpose 

O System and structures of studies are 
easy to navigate 

O Scheduling of teaching and courses 
O Transparency 
O Functioning administration 
O Good student services 
O Students are organised and there is 
a good level of student representa- 
tion {student unions) 

Academic environment and culture 
O Accessibility to higher education 
O Good, motivated student peers 
(quality student body) 

O Engaging, interactive academic 
community 

O The university is committed to de- 
velop its teaching 

o 


O Internships 
O Ability to get a good job 


It was mentioned on a number of occasions throughout the data, how expectations 
are fulfilled, how they live up in reality and how expectations and motivations change. 
This proved to be a pivotal point in the data and analysis. One of the student focus 
groups actually came up with its own definition for quality that was based on expecta- 
tions: “Quality is a measurement for the fulfilling of expectations of a group toward 
higher education ...“. 

Terms like “expectation” and “fulfilment” and “differing from reality” indicate that 
the quality of higher education is linked to processes and should be examined within 
such a context. The analysis therefore led to the core process of Expectations vs. reality 
being identified. The process looks at how students’ expectations are met by universi- 
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ties or, in other words, how the transpiring reality relates to students’ expectations of 
higher education. 


Students' 

expectations 


What transpires 
in reality 



How the university set 
about meeting these 
expectations 


TRUST, PARTICIPATIONS AND OWNERSHIP 


During the data analysis, other key categories emerged. Three key underlying themes 
began to continuously resurface: trust, participation and ownership. Initially they 
were identified as underlying core categories. However, there seemed to be an inher- 
ent link to expectations and the ‘expectations versus reality’-process. Not only could 
expectations be subcategorised as a category of its own under these three themes, but 
some of them could be linked directly to one or more of the three themes. This led to 
the analysis of the expectations in relation to the themes of trust, participation and 
ownership. What was especially interesting to discover, was how the three themes 
were all interlinked, how they built on themselves and how they all contributed to the 
expected and lived experiences of quality. 
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TRUST 


A key issue that students related to the core process of expectations versus reality was 
the information provided by universities, especially its correspondence with the ex- 
perienced reality. 

“The study differs a lot from the brochures..." 

“ The study reality was not represented by information material in most cases. Per- 
sonal references did match [more]..." 

This process was related in the data to the theme of trust. The theme was also coded 
in its negative form distrust, implied also by terms like “disappointment”. It usually 
applied to the core expectations students had from their education (teaching quality, 
content of teaching, employability issues). For example, there seemed to be apprehen- 
sion and distrust towards the information provided to applicants by the university, 
which led to the use of various formal and informal verification processes. 

“Students trusted more in the informal paths than in the official offerings [of infor- 
mation provided by the university]”. 

A key reason for this was that the general information was experienced as being too 
“short” or “neutral”, leading to the used of various verification methods. These includ- 
ed the recommendations of friends and family, discussions with existing students, as 
well as personally contacting various people at the university. 

Student representatives also mentioned how students have been given misleading 
information regarding the nature and amount of contact teaching. An example of this 
was how a “three-day intensive course” turned out to be one three-hour lecture and 
“independent work”. 

An especially interesting example related to trust, mentioned in the student focus 
groups, was how studying led to the aspirations of studying changing from reaching 
good marks (academic merit) to “be[ing] successful at all” (passing), partly due to 
issues like “bureaucratic hurdles”. This is an especially worrisome issue in relation to 
quality, because students come armed with ambition in reaching academic excellence 
only to be sidelined by the system and what could be seen as secondary concerns, 
whereby the motivations and ambitions are lowered. This example also goes to high- 
light how the information given by universities could be seen to be a key point at which 
student expectations are generated. Lived experience, on the other hand, can clearly 
be seen to shape these expectations. 

One element that is not discussed in the data is the role of external influences in 
shaping students’ expectations, such as social and cultural influences. Unfortunately, 
this is outside the scope of the available data. This is, however, an increasingly interest- 
ing point for further inquiry and research. 
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Overall, students appear to put quite a lot of faith in the universities. They trust 
institutions to meet their core expectations from higher education. Of course, this can 
be expected. Higher education can have an enormous impact on a persons future. As- 
sociating these expectations to be standards of quality (a type of measure of success) 
is therefore to be expected. 

PARTICIPATION 

Another key issue identified in the data is the theme of participation. The last exam- 
ple regarding the evolving aspirations of students is also indicative of this theme. It 
could be thought, that “bureaucreatic hurdles” are in the way of full participation in 
the processes of higher education. The expectations linked to this theme tend to be the 
conditional expectations, namely services, facilities and system structures related to 
studying and academic environment and culture. 

Students require systems and structures that enable them to participate fully in the 
learning processes. Things brought up by students and student representatives include 
issues related to facilities and equipment (lack of study spaces, lack of lecture halls, the 
size of teaching spaces, lack of equipment, lack of study materials) and the shortcom- 
ings of the study system (excessive workloads, timetabling issues, lack of feedback and 
constructive evaluation from teachers, worries related to self-sustenance). 

At the same time, the academic culture and interaction is thought to be an impor- 
tant part of the studying experience, which also enables learning. Learning to respect 
different opinions and learning to make arguments was an example of this. Students 
value learning from each other and expect that fellow students have similar motiva- 
tions and ambitions from studying. An active, discursive culture was also thought to 
be important and was expressed by one group as “getting wired ideas”. When asked 
about to mention a valuable learning experience, another student focus group men- 
tioned 

“having colleagues interested in the same things you are... so [you are in] discussion 

with your future colleagues .” 

Nonetheless, the socio-cultural dimension was also brought up by references as op- 
portunities for students and the academic community to bond during leisure-time, 
for example sports and culture. 

It is worth mentioning here, that the existence of good student representation and 
student organisations, were also mentioned in the data. 

All in all, participation as a core category appears to build on trust. This includes 
having all the necessary information to partake in educational processes and that the 
information is reliable and in line with reality. 
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OWNERSHIP 


Of the three themes, ownership was the last to fully emerge. There were many indica- 
tors of it in the data. At first they were grouped with the participation theme, but it 
soon became clear that ownership provided a new dimension altogether, questioning 
how the processes and concepts related to quality are owned by actors in the field. 
It first surfaced during the discussion surrounding quality assurance activities and 
quality culture, but its tentacles were found to reach conceptualisations of quality in 
general. In a way, it could be seen as an area where quality assurance and quality re- 
ally collide. This was found to be an interesting observation. Ownership appears to 
encapsulate both trust and participation, but brings them to a more intensive level: the 
processes associated with trust and participation, including management of student 
expectations, are owned by the university community and its internal stakeholders. 

Issues mentioned during the interviews include how the groups and people func- 
tioning in university environments should strive towards the same goals; that the 
quality of a module was not dependent on the higher education institution but the 
teacher (a person); how teachers should not teach because “it’s a job” but because of 
they are committed and “put their soul into it”; that the university as an organisation 
is dedicated to developing education; and that students should be seen as full partners 
who participate actively in the development of their education. 

Another thing mentioned during the interviews, especially by student representa- 
tives, was the implementation of international higher education policies at the local 
and national levels. A good example of this is the adoption of the degree structure 
outlined in the Bologna process. In some cases, the studies were restructured with 
no reference to students’ workload and they were not divided appropriately among 
progressive degrees. This affected the students’ workload and was seen to harm the 
learning process in cases where, for example, a four-year degree was squeezed into 
three years. 

Finally, ownership could be seen as in intrinsic level of motivation in engaging with 
the processes associated with quality that surpasses mere participation. In as such, it is 
also reliant on the participation, and, by default, trust. 
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EMERGENCE OF THE BUILDING BLOCKS OF QUALITY— HOW TRUST, PARTICI- 
PATION AND OWNERSHIP FORM A CORE PROCESS IN QUALITY 


Trust, participation and ownership could be seen to be the building blocks of quality 
in higher education. They provide the integral elements and principles on which qual- 
ity can be constructed by the people and institutions involved. As was already men- 
tioned, they also build on each other. In as such, their relation to each other seems to 
indicate a type of progression. This could be seen as the underlying foundation proc- 
ess on which quality lies. 


o Striving for academic excellence and gaining general 
competence is a common goal 
o Institutional commitment to developing learning and 
teaching 

o The university, the staff and the students take owner- 
ship of their respective roles and processes, “put their 
soul into it” 

Ownership 


Participation 


Trust 

o Students trust the university to meet their expecta- 
tions regarding teaching content and learning, as well 
as services, facilities any system structure 

o The university adopts transparency in managing 
student expectations 

o Students are trusted as members in the academic 
community 

o Students trust the university to arrange and 

resource studies and facilitie so as to enable them to 
participate 


o Accessibility of higher education 
o Applicants have the information and tools to partici- 
pate in decision-making about higher education 
o Student peers are motivated 
o Access to use facilities and learning resources 
o There are opportunities to participate in culture and 
free-time activities 

o Students use academic social interaction and discus- 
sion in the university community — to be inspired and 
get “wired ideas” 

o University structures and practices are transparent 
and easy-to-navigate, enabling students to participate 
fully in their studies 

o The student workload and time management enable 
students to participate effectively in their education 
o Students are organised and participate in their learn- 
ing process as partners at the university 
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As discussed earlier, this progressive process is heavily connected to expectations 
and how they transpire in reality. In effect, their dualistic relationship, the sum of the 
analysis, can be displayed in the following manner: 



► 



Since most the discussion focused on students’ perceptions related to the quality of 
higher education, it could be surmised that what we have here is at least a rough idea 
of a student-based concept of quality. This model points towards the student concept 
of quality being a process in which quality outcomes depends on how well universities 
meet students’ expectations, and how well quality processes and the realisation and 
management of student expectations are owned by the university. 

DISCUSSING QUALITY ASSURANCE 

The outlined processes and themes related to quality are mirrored in the conceptuali- 
sation of quality assurance. In the context of the data, quality assurance could be seen 
as the act of detecting how well the processes of quality outlined above play out and 
how they can be developed in university contexts. Like the object of its detection, the 
three key principles of trust, participation and ownership also apply directly to qual- 
ity assurance activities. This can be seen in how students, student representatives and 
university representatives all have expectations of how quality assurance activities 
work and how they should function in relation to the core and conditional expecta- 
tions. That these three principles also apply in quality assurance, reinforces their role 
as key elements in activities related to quality in higher education. The same can also 
be said about the three elements being a process: as in the case of quality, trust, par- 
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ticipation and ownership also provide a progressive framework for adopting quality 
assurance systems. 

TRUST 

The theme of trust unfolds on many different levels in the data and in various activities 
related to quality assurance. 

An important issue that relates to trust is (getting used to) change. At institutions 
where interviews took place and where quality assurance is not a new area of activity, it 
is identified as being, first and foremost, an internal issue. However, in cases where the 
phenomenon is relatively new, quality and quality assurance seem to be considered 
“international” concepts, which have been externally imposed via domestic policy. In 
these countries, trust towards these practices is still developing (particularly in East- 
ern European countries). This element of external imposition is reflected not only by 
university representatives but also in students’ stories. At one institution, the follow- 
ing was discussed: 

“Some students think that they are definitely heard when speaking about social issues 
but they are not so confident about whether their opinion is taken into account when 
speaking about global issues like education reforms and quality of studies." 

The successful adoption of work in bettering quality requires adopting a so-called 
“quality culture”. This usually means a working culture in which all actors develop 
ownership of their activities and in which decentralised elements of quality assur- 
ance become paramount. This includes stakeholder participation and consultation 
(especially with students). In countries where this is the norm, the data from the in- 
stitutional site visits indicates that there is a high level of internalisation of quality 
assurance activities and processes and a relatively good quality culture. This, however, 
appears to be rather difficult in higher education systems and institutions, which are 
used to having hierarchical and/or highly centralised management systems. 

This is reflected in the data by examples of how management and staff are used to 
“older practices” or centralised systems and how they are weary or sceptical of adopt- 
ing new practices. Students also appear to be somewhat unaccustomed to “open space 
discussions” and may be “afraid of complaining.” It would appear that in the case of 
staff, age is also a factor in this. At one institution in particular, students felt they could 
more easily approach younger staff members. 

“ Some teachers accept our suggestions if you approach them... young teachers react 
better and like it when students come with new ideas for teaching... older teachers 
do not react well." 


PAN-EUROPEAN CASE STUDY 


29 


This kind of process towards internalisation could be thought of as being cultural as- 
similation. One university level manager remarked how there had been changes in 
attitude. According to them, the introduction of different quality assurance activities, 
for example international review activities, have inspired people to experience for 
themselves that: 

"... Quality assurance is good... it helps... it's not necessarily an enemy... quality is 
a "friend", not a form of control." 

The same manager had noticed this kind of change in her teaching work. In one course, 
students had been allowed to assist in planning the next week’s lecture. They went 
on to design the lecture and gave presentations themselves. The lecture was a success 
and the students were left “wanting more”. She had, at the point, felt unable to take 
too much time out of the planned teaching schedule for such activities. However, the 
positive feedback was enough to make her reconsider that the teaching and lecturing 
methods need to be changed. 

Processes relating to change in working cultures can be slow. This is also the case 
when putting formal quality assurance structures into practice. At one institution, 
a member of the university management felt very pleased with the level of improve- 
ment shown in the work of quality assurance bodies in different departments, when 
the reports were, for the first, handed in on time instead of the departments “always 
delaying” this process. In effect, adopting any quality and quality assurance activities, 
not to mention cultures, requires a good level of awareness and long-term encourage- 
ment of all higher education groups to take part in quality assurance and development 
activities. 

With regards to student engagement, the trust issue is particularly important. It 
presents the first and the most difficult obstacles to participation in quality assurance 
activities. Firstly, students should be trusted as partners. Students stated, for example, 
that the lack of a welcoming attitude on behalf of the university staff towards student 
engagement, which can be seen to clearly limit student participation. As a result, it 
could be seen that: 

“ Students don't really believe in the efficiency in the channels for communication 
with the university management." 

Secondly, with students also being new to quality assurance activities, they also need 
to be encouraged to participate in those processes. At one institution, students were 
very unaccustomed to an “open discussion”. Also, a welcoming, open environment 
needs to be fostered. A good practice at one institution highlighted how: 

"The first lesson was [organised] to cooperate with the teachers, the teachers moti- 
vated students to do this, to feel open." 
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Thirdly, a major issue that students have in terms of trust is the fear of being critical 
towards the university or teachers. This is especially true if there is a power paradigm 
involved, for example how the teaching staff gives grades. 

“The students stated that they can express their opinion free[ly] in most cases. Only 
towards special docents where students fear repressions in their exams or a general 
punishment in a course in the case of [giving] bad evaluation results [to teachers]." 

This fear is exacerbated in situations where students’ scholarships and finances de- 
pend on their marks and academic achievements. In all site visits, students placed high 
value on anonymity and security in giving feedback. Students tend to mistrust univer- 
sities’ promises of anonymity especially when a feedback system requires some form 
of personal identification or traces, such as logging in. 

Fourthly, the trust that students place on the system of student representation is 
an area of concern. In order for student participation to work, a functioning system of 
student representation is needed. This requires awareness of such a system, but also 
trust in the system and towards on the part of students those students working as rep- 
resentatives. In some cases, the student representation system seems to work very well, 
but in others not all. The following quotation sums the overall feeling in the data: 

“Some feel if they have problems, they can contact student representatives. Some feel 
they are good, some feel they are not as approachable as they can be. Some people do 
not understand what they do." 

Trust in the student representation is also dependent on the overall trust placed in 
students as partners. 

“The reps are not really heard... they can vote but not enough to change anything... 
feel like the power is only formal one... doesn't really help". 

Lastly, communication plays an increasingly important role in maintaining students’ 
trust in quality assurance activities. Failure to actively acknowledge students’ input 
and feedback and the failure to communicate or provide observable improvements, 
can make students feel that their feedback is of little value. This leads to an overall lack 
of trust and lack of faith in quality assurance systems. 
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PARTICIPATION 


While trust would, in the case of quality assurance, also be a key element in adopting 
quality assurance or, indeed, a quality culture, the next principle is participation. 

The data indicates that a lack of general awareness of quality assurance is a major 
obstacle in reaching the goals of participation. While in some places, students had a 
relatively good idea of what quality assurance means and how students can participate 
in it, this was not the case in all institutional site-visits. In one, the interviewing team 
states how: 

“There was a big group of students who was completely not aware of any accredita- 
tion procures and didn't associate student questionnaire [s] or any other tools with 
quality provision. In the group where students were aware of quality assurance pro- 
cedures, the opinion and level of knowledge [differed].'' 

Based on the examples from data, it appears that awareness of quality assurance is 
often enhanced when there are students who look up the university’s accreditations 
or certificates online, when they have student friends on quality assurance bodies or 
teaching development units, and when the pictures of quality assurance bodies, in- 
cluding student members, are online. 

Of course, it is not always sufficient to be simply aware of these procedures. The 
participants need to be equipped with a certain knowhow in order to engage in these 
activities. This is the case for students, student representatives and university staff 
working in quality assurance. Students need to receive guidance on how they can give 
constructive feedback. This is evident from an interview with a university staff mem- 
ber, who remarked how students do not always give “useful feedback.” In the case of 
student representatives, one student representative remarked how “there is a lack of 
training on quality assurance.” 

A key aspect relating to participation is how the lack of “genuine participation” of 
students and how the formal information regarding student participation does not 
transpire with practices in reality. 

“There is not really a genuine participation of students in higher education , despite 
the fact that it is on paper." 

This, of course, is related to the role of students being equal partners and whether they 
are trusted as such. 

It would also appear that a key element of quality, already identified in the earlier 
section, having well balanced study workloads, bears relevance in students participat- 
ing actively in quality assurance activities. Student representatives in quite a few insti- 
tutions described how heavy and stressful study workloads resulted in high thresholds 
for taking up voluntary work, including student representation in university bodies, 
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such as teaching development units and quality assurance bodies. This was felt to be 
exacerbated by the experience that “students do not feel as equal partners” in such 
bodies and if there was generally a lack of the university as a whole participating in 
quality assurance activities (too few meetings, inactivity of bodies, limited or dys- 
functional work of bodies). 

A key issue brought up by both student representatives and university staff was 
how participation requires taking initiative. They mentioned how: 

“Often, one only needs to speak up about the problems... if someone takes the initia- 
tive, it's discussed usually ." 

There was some discussion on students’ lack of interest to participate in quality assur- 
ance activities. At one institution, there were students who doubted the effectiveness 
of quality assurance mechanisms, but who had not, on the other hand, tried to solve 
any problems either. It should be noted that this is not necessarily caused by slack, 
rather it is linked to students being encouraged to participate and their awareness of a 
quality culture and their roles within it. An encouraging atmosphere is enhanced by 
the welcoming attitude of university staff. At another institution, one law student had 
suggested that a study excursion to a court of justice should be organised at a study 
course. Apparently, the teacher had been very pleased and keen about the idea. The 
suggestion had not yet been taken up at the time when this study is written, but for 
the student the: 

“[ m]ost important thing is they did not say no immediately .” 

OWNERSHIP 

Like with quality, the next step in the process of having successful quality assurance 
in place is acquiring ownership. Ownership is key for internalising and successfully 
adopting quality assurance practices and a quality culture. 

There are various obstacles in the way of universities and their internal groups are 
able to claim ownership of their quality assurance activities. Formal steps towards 
integrating quality assurance are key, but are not sufficient in themselves. A manifes- 
tation of this how student participation in quality assurance may exist “on paper” but 
not in reality. This kind of partial integration suggests that a process (even by-law) is in 
place, but that the university has not taken ownership of it. As one student indicated, 
this is a “very superficial approach”. This kind of superficial approach is also apparent 
in cases where student representatives are selected by the university and not by stu- 
dents themselves. In such cases, students are not able to claim ownership of their own 
role in a university democracy. 
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A key issue raised by students that relates to ownership is the need for teaching 
staff and the university to accept the feedback of students. Essentially, this means that 
the teacher needs to take ownership over the process of collecting feedback on his/ 
her own teaching. Students feel that the functionality and success of quality assurance 
activities is highly dependent on the acceptance of and goodwill towards the process 
by the subject of the quality assurance activity in question, for example a teacher. 

“The students stated that every method for quality assurance can only be good if the 
evaluation process is accepted by the evaluated " 

"Relevance of [own feedback] is mostly dependent on the acceptor" 

In fact, students felt that this aspect of ownership has the “biggest influence” in as- 
suring quality in a successful manner. There are also cases in the data where the level 
of acceptance of staff to student feedback appears to differ across different levels and 
different members of staff within an institution. In the latter case, the students stated 
that their influence was greater on institutional level than on the programme level. 
This suggests that these particular institutions have not yet managed to disseminate a 
functioning quality culture and among their staff. 

It was mentioned before how universities may feel that quality assurance is exter- 
nally imposed. Symptomatic of this is how some universities seem to feel that student 
representation in quality assurance is forced on them. There was talk in the data of 
how interviewees viewed quality assurance as being internally “forced upon different 
groups” at a university. Forcing, of course, suggests something unpleasant and that 
there is reluctance. Similarly, when quality assurance is seen to be more of a “formal” 
aspect stemming from the central level of the university, it becomes almost divorced 
from the day-to-day workings and culture of the university. 

It is important to note here, that students have also not yet completely adopted 
quality as an area of work by themselves. The data indicates towards students partici- 
pating more in student union activities that involving social dimensions and everyday 
life (food, housing, living conditions) instead of issues like quality. In one case, aca- 
demic issues were seen to be issues at the national level, not institutional level ones., 
and in another quality issues were seen to be “global” issues (mentioned before). 

Another key issue raised by the participants is how the ownership of different qual- 
ity dimensions factors into quality assurance activities, e.g. the feedback of students. 
Emphasis was placed on the different levels where feedback could be provided, how 
useful it is, where the impact of the feedback is apparent, and what is asked and how. 
For example, students indicate that a feedback survey is good only if it asks the right 
questions and has the right scope. 

“In order to be efficient it should not only look into the teacher’s performance but also 
into proposals for curricular development " 
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Hence, a key element of good feedback collection mechanisms means addressing all 
the key areas in which students have core expectations. Another key element of feed- 
back is the need for making constructive feedback possible. This need was identified 
by both students and university management alike. While numerical or statistically 
viable responses are a useful tool, they are not that productive in resulting in change. 
Instead, “more open questions are needed” which are seen to result in more “direct 
and constructive feedback.” 

An intrinsic part of claiming ownership of student feedback and quality assurance 
activities is to have transparent communication on the impact of the feedback with 
those who provide the feedback. This reinforces the idea that they are being heard, so 
as not to evoke feelings that, for example, it is “just a formal initiative coming from the 
institution to fill these questionnaires”. 

A key issue that came up in the discussions all across the board was the need for an 
institutional commitment to quality assurance and development. The practices that 
were mentioned included a set of clear aims related to these in the institutions mission 
statement. In one case, this meant that: 

“ Based on the development plan of the university , all activities in the field of qual- 
ity development in teaching and learning were brought together in a single concep- 
tual strategy." 

In another case, quality assurance work was seen to be similarly reliant on “the agree- 
ment of objectives”. This was viewed as being crucial in stimulating the implementa- 
tion of quality improvement processes at the faculty and other levels. 

EMERGENCE OF THE CORE PROCESS OF QUALITY ASSURANCE 

As with quality, trust, participation and ownership can be seen to be the building 
blocks of quality assurance in higher education. They provide the integral elements 
and principles which universities and the actors within them should adopt. And, same 
as with quality, these principles also build on each other and their relation to one an- 
other other seems to indicate a progression. However, what is different is that various 
formal dimensions of structures of quality assurance are also inherent to this process. 
Seeing as the formal dimensions are, in their own way, starting points for quality as- 
surance activities, they cannot, as such, be included in any of the three principles/ 
phases. The effectiveness of quality assurance can therefore be depicted as the rela- 
tionship among the three principles and the formal dimensions. 
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OTHER CONSIDERATIONS 

There were a few issues that came up in the analysis that would need to be mentioned 
but which did not fit the scope of the main research. 

The term “quality” was translated into similar but also ambiguous terms such as 
“prestige” and “good” but also “international” and “reputable” in the data. The idea 
that quality is interchangeable with these terms is interesting because none of these 
concepts, some more than others, are easy to describe or explain and their meaning 
and significance rely heavily on context. The use of the term prestige is especially in- 
teresting. Out of all the terms, its ambiguity falls in the same class as that of quality. 
When students or universities expect “prestige” in higher education, what are they 
expecting? This would be an interesting area for further research that would give more 
insight into the generation of students’ expectations towards universities and how 
universities can set about managing students’ expectations better. 

Another area that would be useful to research more in-depth is the division be- 
tween the “formal” and “informal” dimensions of quality and quality assurance. What 
areas can be seen as formal or informal? What activities fall in either category? One 
crucial issue that could be examined is with which student participation and the de- 
velopment of quality are associated. 

In one institution it was mentioned that students felt that being “clients” (consum- 
ers) made the university more effective. However, it would be very interesting to con- 
duct a more in-depth, comparative case study about this particular type of context in 
relation to the theory that has emerged from this study. It could be speculated whether 
this feeling stems from lack of trust, participation and ownership, where students seek 
reassurance from a different kind of a power paradigm. 
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CONCLUSIONS 


The findings of this study indicate that quality, in the eyes of students, is a much wider 
concept than the sum of its attributes. Students’ perceptions on quality, and thus qual- 
ity assurance, revolve around the processes relating to how student expectations are 
generated and met, the ownership of these processes, and how these processes incor- 
porate the main principles of trust, partnership and ownership. This relates especially 
to the treatment of students as equal partners and the need for student participation. 
The same principles are also found to be present in quality assurance activities, rein- 
forcing their existence as key building blocks in constructing and developing higher 
education. 

The analysis indicates that due consideration needs to be taken in order to under- 
stand the students’ role and students’ circumstances more effectively in student par- 
ticipation. Issues such as workload, the equal status of students as partners, encour- 
agement and the provision of necessary knowledge and tools, are key in optimising 
student participation in any work related to (the quality of) higher education. 

The section on quality assurance also indicates that adopting quality assurance 
and quality cultures is a gradual process. The adoption of quality assurance activi- 
ties in higher education and translating international level higher education policy to 
national and local levels seems to be a tricky and slow process. It would appear that 
the first step would be to adopt formal structures. However, it is essential to continue 
that development further; among the key lessons that can be learned from this study 
is that trust, participation and ownership related activities must be enhanced in order 
to move this process forward. This requires a firm commitment from all stakeholders 
and groups involved in higher education. 

The findings of this study are in line with the outcomes of the other research parts 
that have been completed in the quest project, including the consultation conference 
with stakeholders held in Malta in December 2012 (see the previous chapter of this 
publication). 

The first part of Volume II in the quest research publication series, called “ Quest 
for Quality: Survey on Students Perspectives", implies that students had “a multi-dimen- 
sional concept of quality in higher education” (esu, 2013). The research findings based 
on the institutional site visits also reflect this concept. The difference here is that, while 
the survey investigates levels of agreement with certain pre-defined dimensions of 
quality, this current study investigates students’ conceptualisations more inductively 
(user-based), with the result being a concept of quality that centres on students’ ex- 
pectations and how they are met. However, these expectations and related processes 
(such as employability, commitment of teachers, being a part of an academic culture, 
and others) can, in general, be seen to correspond with the dimensions of quality used 
to frame the survey study (quality as transformation, quality as added-value, etc.). 
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The findings of this study are also supported by Volume I of the quest publication 
series, called "quest /or Quality for Students: Going Back to Basics". That publication 
included a desk-research that showed how student participation in quality assurance 
has increased since the beginning of the Bologna process, especially since the Europe- 
an Standards and Guidelines for Quality Assurance in Higher Education were adopt- 
ed in 2005. The authors of said publication identified various obstacles that students 
face in their involvement in quality assurance. The highlighted problems included not 
only involving students, but the empowerment of quality assurance itself to lead for 
real improvement. It was seen, through the eyes of national student representatives 
that formally outlined student involvement within quality assurance structures does 
not always mean genuine and active student participation in quality assurance. Their 
reports also identified large differences in the level and quality of student involvement 
in quality assurance among the countries of the European Higher Education Area. 
That quality assurance systems are still new or underdeveloped was seen as a possible 
cause of this (esu 2012). Collectively, all these prior observations support the idea that 
trust and participation are, indeed, key issues in developing working quality cultures. 
They also reinforce the notion that quality assurance systems need to be developed 
gradually. 

Similar strains of discussions took place during the consultation conference with 
stakeholders in Malta in December 2012. The general report from that conference also 
calls for the need to move beyond formal structure, i.e. the “need to move away from 
the notion that quality assurance is purely a bureaucratic process”, and the need for 
“external mechanisms for quality assurance [to] foster the idea that institutions are 
responsible for their own quality”. This reinforces the findings of this study, namely 
that higher education institutions need to take ownership of these processes. What is 
even more interesting, however, is how student participation “on paper” (an issue dis- 
cussed by interviewees in this study), can be seen to be a manifestation of this trend of 
viewing quality assurance as a purely bureaucratic process. It could even be said that 
the degree of student participation may serve as an indicator for the effectiveness of 
quality assurance mechanisms and the level of quality culture in place. 

In terms of the key findings of this study, it was particularly interesting to find that 
the aspects of trust and ownership were mentioned already in the conclusions of the 
first publication. It is stated how “ownership and mutual trust are key factors in creat- 
ing a quality culture” (esu 2012, p.23). The literature review in “Quest for Quality for 
Students: Going Back to Basics” also shows how numerous authors affirm the benefits 
of student involvement, not only for the processes and its outcomes, but also for creat- 
ing ownership amongst all members of the academic community as co-responsible 
stakeholders. It can, beyond doubt, be said that the analysis from the institutional 
site visits reaffirms the validity and place of trust, participations and ownership alike. 
However, according to this study they are not only crucial factors, but they also repre- 
sent key stages in the gradual process towards developing quality cultures and effec- 
tive quality assurance mechanisms. 
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The findings of this study provide an insight into students’ concepts of quality 
higher education, the obstacles that students face when getting involved in quality as- 
surance activities and the general conditions required in order to overcome these chal- 
lenges. In so far as the issues of trust, participation and ownership come in, it could be 
inferred that, in order to surpass these challenges, general capacity-building measures 
need to be taken so that students can participate fully in these processes. However, it 
can also be said that adopting quality assurance systems and fostering quality cultures 
means taking a leap of faith in adopting students as equal partners. 

In conclusion, more research is required on how students’ expectations are gener- 
ated and how the quality of higher education is conceptualised, especially in relation 
to external influences. It is important to note that the results of this study do not pro- 
vide exhaustive answers or definitions for quality. As with most grounded theories, 
the results here yield as many questions as they do answers. Still, the analysis and find- 
ings do provide a useful theoretical framework for how quality and quality assurance 
are perceived and experienced as phenomena and processes (by students), how qual- 
ity is formed, and what issues affect these outcomes. This framework can aid European 
students, higher education institutions and other stakeholders in higher education in 
achieving better levels of quality in higher education. 


THESE ARE THE MAIN FINDINGS OF THIS CHAPTER: 

O A model for pursuing quality emerges from the institutional site-visit data, 
which views quality as a process centred on students’ expectations and how 
they transpire in reality. 

O Students’ core expectations for quality higher education include the teaching 
content and learning process while conditional expectations are related to 
the environment and conditions that are believed to be necessary in realis- 
ing these core expectations, such as services, facilities and system structures 
related to studying, as well as the academic environment and culture. 

O Quality, in the eyes of students, is a much wider concept than the sum of its 
attributes. 

O For students, quality is essentially an experience or process that takes place 
within the process of how their expectations are being met in higher educa- 
tion. 

O The principles and values necessary in building quality in higher education are 
trust, participation and ownership. 


PAN-EUROPEAN CASE STUDY 


39 


O Student participation in all levels of quality assurance and decision-making in 
higher education is needed in order to pursue quality in higher education. 

O Universities need to develop their communication and information channels 
in order to manage student expectations better. 

O Universities should consider and understand the students’ role and students’ 
circumstances more effectively in student participation in quality assurance, 
taking note of the obstacles such as excessive study workload, unequal status 
as partners and lack of necessary knowledge and tools. 

O Students need to be encouraged to be active, take responsibility for their role 
as partners and to take initiative. 

O Adopting quality assurance and quality cultures is a gradual process. Key 
steps in this process are enhancing trust, participation and, eventually, owner- 
ship of quality related activities. 

O The degree of student participation may serve to indicate the effectiveness of 
quality assurance mechanisms and the level of quality culture in place 

O More research is required on how student expectations are generated and how 
quality is conceptualised, especially external influences. 

O The relationship between the different spaces in which the formal and infor- 
mal areas of quality and quality assurance play out is also a worthwhile area 
for further study. 
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OVERALL FINDINGS 


In this section, we have compiled the main findings from the stakeholder consultation 
conference, held in Malta from 30 November to 1 December 2012, and the findings of 
the institutional site visits, which were analysed in the pan-European case study in- 
cluded in this report. The overall findings have been categorised under three themes: 
quality of higher education, student participation and general developments. 

These observations contribute to the main goals of the Quest for Quality for Stu- 
dents (quest) project. The project aims to identify students’ perceptions of what 
quality in higher education is and how students can become more involved in quality 
assurance and enhancement processes. The research outcomes also contribute to the 
aim of the European Students’ Union, to define a student-based concept for the qual- 
ity of higher education. 


5.1 ON QUALITY OF HIGHER EDUCATION 

O A model for pursuing quality in higher education emerges from the insti- 
tutional site-visit data, which views quality as a process centred on student 
expectations and how they transpire in reality. 

O Quality, in the eyes of students, is a much wider concept than the sum of its 
attributes. 

O For students, quality is essentially an experience or process that takes place 
within the process of how their expectations are met in higher education. 

O Students’ core expectations for quality relate to the teaching content and 
learning process while conditional expectations are concerned with the en- 
vironment and conditions that are thought to be necessary in order to realise 
these core expectations, i.e. services, facilities and system structures for study- 
ing, as well as the academic environment and culture. 

O Universities need to develop their communication and information channels 
in order to manage student expectations better. 

O Rankings can be an instrument for providing transparency, but it is very dif- 
ficult to encompass the quality dimension of education. 
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O The principles and values necessary to build quality in higher education are 
trust, participation and ownership. 

O More research is required on how students’ expectations are generated and 
how quality is conceptualised, especially in relation to external influences. 


5.2 ON STUDENT PARTICIPATION IN QUALITY ASSURANCE 


O Student participation in all levels of quality assurance and decision-making in 
higher education is needed in order to pursue quality in higher education. 

O Students have responsibilities as stakeholders and as partners. 

O It is extremely hard for students to engage as equal partners if students also 
assume/are given a role as consumers in education. 

O If students provide feedback, they need to be made aware of the changes they 
have initiated and that their input was valued. 

O Students need to be encouraged to be active, take responsibility for their role 
as partners and to take initiative. 

O Students’ motivation for participating in quality assurance and development 
activities can be enhanced only if the quality assurance activities and proce- 
dures are effective and made visible. 

O National policies and legislative frameworks are necessary, but not sufficient 
to ensure student participation in quality assurance. 

O Universities should consider and understand the students’ role and students’ 
circumstances more effectively in student participation in quality assurance, 
taking note of obstacles such as excessive study workload, unequal status as 
partners and lack of necessary knowledge and tools. 

O It is important that students themselves are active in advancing student en- 
gagement, training other students and making quality assurance activities an 
interesting and appealing part of the university life. 
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5.3 ON GENERAL DEVELOPMENTS IN QUALITY ASSURANCE 


O There is a strong need to move away from the notion that quality assurance is 
purely a bureaucratic process. 

O External mechanisms for quality assurance should foster the idea that institu- 
tions are responsible for their own quality. 

O Quality assurance procedures will not assure quality alone, but they are able 
to detect it. 

O Too much regulation on the learning process might lead to less innovation, 
which is, too, a part of quality education. 

O The impact of quality assurance activities often comes with a delay. 

O A single tool for transparency in higher education is not sufficient. 

O Adopting quality assurance and quality cultures is a gradual process. Key 
steps in this process are enhancing trust, participation and, eventually, owner- 
ship of quality related activities. 

O Despite the external review philosophy being based on the continuity of the 
process, in practice this does not really happen. 

O The degree of student participation may serve to indicate the effectiveness of 
quality assurance mechanisms and the level of quality culture in place. 

O More needs to be done in order to make the reports and outcomes of quality 
assurance truly accessible to the stakeholders and the wider public. 

O The relationship between the different spaces in which the formal and infor- 
mal areas of quality and quality assurance play out is also a worthwhile area 
for further study. 
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ANNEX I— QUEST CONSULTATION 
CONFERENCE WITH STAKEHOLDERS 

FROM 30 NOVEMBER TO 1 DECEMBER 2012 
Conference programme 

30TH NOVEMBER, FRIDAY 
Part I: Setting the scene 


09.00-10.00 

Welcome words and introduction 

O Mario Cachia, President of ksu 

O Prof. Juanito Camilleri, Rector of the University of Malta 

O Hon. Dolores Cristina, Minister of Education and Employment 
(tbc) 

O Karina Ufert, Chairperson of esu — Recent developments in qa 
and way forward 

10.00-10.30 

Presentation of quest project outcomes, preliminary findings of 
esu research activities 

by Liliya Ivanova, Executive Committee member of esu . 

10.30-11.00 

Coffee break 

11.00-12.30 

Parallel working sessions 

Session v. The link between external and internal quality assur- 
ance 


Input by: Representative from Malta, Quality Assurance sector 

Dr. Marja-Liisa Saarilammi, Finnish Higher education evaluation 
council (finheec) 
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Session 2: Impact of quality assurance through visibility 



Input by: Representative from Malta, Quality Assurance sector 

Axel Aerden, Accreditation organisation of the Netherlands and Flan- 
ders (nvao) 

Session 3: Stakeholders’ participation in Quality Assurance 

12.30-14.00 

Lunch break 

14.00-15.30 

Roundtable discussion — “quest for More Europe?” 

O Tia Loukkola, Head of Unit Quality Management, European 
University Association (eua) 

O Achim Hopbach, President of European Association for qa in 
Higher education (enqa) 

O Stephan Delplace, Secretary General of European Association of 
Institutions in HE (eurashe) 

Moderator: Allan Pall 

Rapporteur: esu 

15.30-16.30 

quest Cafe — restyled World Cafe for quest 
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1ST DECEMBER, SATURDAY 


Part II: Getting a grip on recent developments in 0A 

09.30- 10.30 Discussion-Not everything, that can be counted, counts? 

U-Multirank presentation by Dr. Don Westerheijden, Centre for 
Higher Education Policy studies (cheps) 

10.30- 10.45 Coffee Break 


Part III: QUEST for Quality for Students 


10.45-12.15 Parallel workshop sessions — developing students’ quality con- 

cept 

1 ESG implementation — what we can learn from the past? 

2 Students’ participation in QA — status quo. 

3 Students’ engagement in QA — support mechanisms. 

4 How to connect the three key quality circles: teacher, student and 
quality? — Christine Lechner, Innsbruck University 

5 EU2020 Review — Elisabeth Gehrke, esu 

12.15-13.00 Lunch break 

13.00-14.30 Parallel workshop sessions continue 

1 ESG revision — way forward — Karina Ufert, esu 

2 Students’ participation in QA — how to strengthen it — 

Libya Ivanova, esu 

3 Students’ engagement in QA — support mechanisms — 

Iain Delworth, sparqs 

4 EU2020 Review — Elisabeth Gehrke, esu 


14.30-14.45 Coffee Break 
14.45-15.30 Closing part 

Address by Dr Philip von Brockdorff, Chairman of the national com- 
mission for Higher education (ncfhe) 

Final report of the Consultation seminar by Alina Gavra 
esu Closing remarks 
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ANNEX II— SITE VISIT GUIDELINES 


These guidelines aim to help the review team to prepare for the institutional site vis- 
its. 

Obligatory list of interviews to be arranged / Default list of interviews to be ar- 
ranged: 

O Interview with the a representative of the quality assurance unit (or similar) in 
the higher education institution 

O Interview with the student representative in charge of academic affairs and 
quality 

0 Focus group exercise with students, 8-10 people including undergraduates and 
postgraduates. 

METHODOLOGY 

The site visits form an important basis for conclusions — with quest research aiming 
to provide answers of the following questions: 

1 How can students’ participation be enhanced through quality assurance and 
enhancement mechanisms/systems/frameworks? 

2 What sort of information do students need to be provided to them in relation 
to what they perceive as quality education? 

The site visits will employ the methods of active/passive observation as well as of in- 
terviews and student focus group exercise. 

Site visits will be organised with the help of the respective national unions and/or 
project partner. 

The site visits will be conducted by a team consisting of two experts (ESU and project 
partners’ representatives). Members of the ESU QA experts’ pool, trained during the 
workshops organised on the project, could be also selected to be part of these teams. 
A site visit will last approximately 2 to 3 days. After each site visit a report will be pro- 
duced, which is a responsibility of site visit coordinator in cooperation with the other 
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team member. These reports will be produced on the basis of the input received during 
the interviews and the focus groups 

Methodology for constructing the focus group: 

The sample for the focus group has individuals with characteristics of the overall pop- 
ulation and aim to contribute to helping the research gain a greater understanding of 
the topic. When constructing the focus group a balance between the representatives 
of the different academic units of the higher education institution should be respected. 
Inviting institution should present a list for the participants of the working group to 
the coordinator of the review not later than 7 days before the visit. It is expected, that 
both undergraduate and postgraduate students will be asked to join the review, along 
with the international students. Each focus group will take approximately 1:30 — 2 
hours; the discussion will be recorded for following analysis. It is recommendable that 
there will be 8-10 people per focus group. 

Coverage of costs 

The costs for the site visit will be covered by ESU. This includes economy class travel 
for the site visit team, including the travel to and from the airport/railway station. Ac- 
commodation and food will be also covered, according with the financial rules of ESU 
and in respect of the project handbook. 

Site Visit Report 

The site visit team is required to produce a written report on the whole site visit. This 
report should be finalised 14 days after the site visit is conducted. 

Responsibilities 


Site visit team coordinator 

O Designs the agenda for the site visit 

O Facilitates communication within the SV team and establishes contact to 
hosting institution (NUS, higher education institution, other) 

O Remains in regular contact with the hosting institution (NUS, higher educa- 
tion institution, other) regarding any questions concerning the agenda of the 
site visit, meetings with the students and staff 

O Organises task division in the team 
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O Makes sure the site visit goes according the plan and report being produced on 
time 

O With the help of ESU Secretariat, arranges practicalities, such as travel, ac- 
commodation, food and other 

O Site visit team 

O Comments on the site visits agenda, where relevant 
O Actively participates in all meetings of the site visit 
O Assists in producing the final report 
HOSTING NUS 

O Responsds to the need of site visit team to arrange the interviews and focus 
group with students 

O Arranges meetings, as requested by the site visit coordinator 

0 Receives the draft final report for comments, before it goes to ESU QUEST 
research team 

QUESTIONS TO THE FOCUS GROUPS OF STUDENTS: 

1 Motivation 

a What was your motivation to choose the institution you are currently 
studying in? What factors influenced your choice 

b What is the most rewarding learning experience you have had on your 
programme/course and why? 

c What were your expectations towards the institution and the study 
programme when you were admitted in the university? What were your 
expectations from the enrolment in higher education? How these expecta- 
tions changed 

2 Perceptions on quality 
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a What makes your institution/programme/course a good one? What in 
your opinion are the elements of a good institution/programme course? 

b What makes your experience as a student a valuable one? 

c What is the most rewarding learning experience you have had on your 
programme/course and why? 

d What do you understand by the term quality within your university con- 
text? 

3 Awareness of quality assurance mechanisms 

a Are you aware how the quality of your study programme / institution 
ensured? 

b If yes do you consider that these mechanisms are effective 

c Do you know what EQAR, ESU, ENQA, EUA, ESG isi? Have you heard 
about any European initiatives in the area of higher education? 

4 Information needs 

a What source of information you used when making your decision concern- 
ing higher education? 

b How important was each of these sources? 

c What was the quality of these sources of information? 

5 Academic freedom 

a Do you feel free to express your opinion in the institution where you are 
studying? 

b Do you feel that your opinion is heard? 

QUESTIONS TO THE OA UNIT REPRESENTATIVE: 

1 What quality means to you 
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a What makes your institution a good one? What in your opinion are the ele- 
ments of a good institution/programme course? 

b What makes your experience as a manager a valuable one? 

c What do you understand by the term quality within your university 
context? 

d Can you provide any examples of good practice of improving your teaching 
in your institution? 

2 Quality culture at your institution 

a Could you describe the internal quality assurance system in your institu- 
tions and the student role within it? 

b Do students in your institution have a voice within the university? Are they 
listened to? If so, how is their opinion heard/acted upon? 

c In what contexts, both formal and informal, is quality/ teaching practice/ 
learning experience discussed in your institution? 

d How do you think the institution supports teaching and learning? 

e Is quality something, which is imposed externally? How do you know what 
works well in your institution? 

3 Information needs: 

a What sources of information students use to choose study programme/ 
institution? 

QUESTIONS TO THE LOCAL STUDENT REPRESENTATIVES: 

Discussion about: 

1 What students are most often complaining about in relation to the quality of 

their study? 

2 What are the obstacles for student involvement in the internal QA mecha- 
nisms? 
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